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Abstract. A fluctuation relation for heat engines (FRHE) has been derived recently. 
In the beginning, the system is in contact with the cooler bath. The system is then 
coupled to the hotter bath and external parameters are changed cyclically, eventually 
bringing the system back to its initial state, once the coupling with the hot bath is 
switched off. In this work, we lift the condition of initial thermal equilibrium and 
derive a new fluctuation relation for the central system (heat engine) being in a time- 
periodic steady state (TPSS). Carnot's inequality for classical thermodynamics follows 
as a direct consequence of this fluctuation theorem even in TPSS. For the special 
£H ■ cases of the absence of hot bath and no extraction of work, we obtain the integral 

O . fluctuation theorem for total entropy and the generalized exchange fluctuation theorem, 

respectively. Recently microsized heat engines have been realized experimentally in the 
TPSS. We numerically simulate the same model and verify our proposed theorems. 
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1. Introduction 

Over the past two decades several exact and unexpected relations for exchange of energy, 
heat, entropy, etc. have been obtained that remain valid even for systems driven far away 
from thermal equilibrium. These results, although in principle valid quite generally, 
are in practice relevant mostly for microscopic systems for which the fluctuations are 
substantial. These are called fluctuation theorems [THS]. They transform classical 
thermodynamic inequalities into equalities. Advances in experimental techniques have 
made dramatic progress in the area of single-molecule manipulation and nanotechnology 
have led to experimental verification of the various fluctuation theorems [6j[7]. Recently 
another equality is added to the class of fluctuation theorems, namely, fluctuation 
relations for heat engines (FRHE) |8J. Initially the system is in thermal equilibrium 
with a cold thermal reservoir at temperature T c , and then coupled to a hot thermal 
reservoir at temperature > T c . At this stage, the parameters driving the working 
substance (our system of interest) are changed cyclically so that at the end of the cycle 
all the parameters attain their initial values, and the interaction with the hot reservoir 
is switched off, and the system is coupled to the cold reservoir. The equality reads 



exp 



, 1_ J_\ W_ 

h { T C T h J + T c 



1. (1) 



Here, (• • •) denotes averaging over many realizations of the cycle. Qh is the heat absorbed 
from the hot bath and W is the work extracted from the system in a cycle. 

2. Derivation from Seifert's theorem 

We provide here a derivation slightly different from that given in [HE], by using the 
Seifert's integral fluctuation theorem [9UT0]. (e~ Astot ) = 1 (in presence of multiple baths) 
in conjunction with the first law, 

AE = Qh — Qc — W (2) 

with the total entropy being given by 

Astat = As h + As c + As. (3) 

Ash, As c and As are the entropy changes of the hot bath, the cold bath and of the 
central system, respectively. Denoting the initial and final distributions for the forward 
process by po{xo) and pi(x T ), we have [9j.fT0] 

As, = As c = % (4) 



As = ln^ = ln 



-E{x )/T c Zt 



f. 



Z e-m^/T, 

where AE = E(x T ) — E(xo), and we have made use of the fact that for a cyclic process, 
Z = Z T . Using the first law, eq. (j3]), we have Q c = Qh — W — AE. Thus, As tot becomes 

Qh Qc AE 

^Stot — — — + — + -7W~ 
i-h J-c J-c 
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Qh Q h -W-AE AE 

T h T c T c 

= Qh {k-Y)-Y- (6) 

Seifert's theorem then gives eq. (JT]). 

Equality ([T]), together with the Jensen's inequality gives 

* {k ~ i) " y) s °- (7) 

which can be rewritten as 

r] c being the Carnot efficiency given by t/ c = 1 — |f . This is then, the Carnot's theorem 
for maximum efficiency applied to a mesoscopic heat engine. Now, instead of taking 
the averaged quantities, one can also define the efficiency for each individual trajectory, 
r] = W/Q, which is, of course, a fluctuating quantity. Consequently, there may be 
trajectories along which 77 > r) c , which will be termed as the atypical trajectories 
(trajectories that seem to flout the behaviour dictated by the second law). In fact, 
77 can also become negative, in which case, along a cycle, the system does not perform 
as a heat engine (for example, when heat is absorbed by the system, but work is being 
done on the system [TTj). 

3. Derivation of the FRHE for a time-periodic steady state 

Recently the Carnot engine has been investigated experimentally in the time-periodic 
steady state (TPSS) [12]. In a TPSS, the probability density of system state, p ss (x, t), is 
periodic in time, p ss (x,t + r) = p ss (x, t), where r is the time-period of the external drive. 
The occupation probabilities of a motor in a TPSS, consisting of a two-level system, 
has been studied in [13] . In a TPSS, the probability density for the system state can 
be written as p ss (x,\) = e~^ x,x \ A being the external time-dependent protocol, and 
4>(x, A) is an effective potential. In such a case, the condition of initial equilibration of 
the working substance with the cold bath ought to be lifted. Once again, in a part of the 
cycle, the system is connected to the cold bath, while in the other part, it is connected 
to the hot bath. In this case, the change in system entropy during a cycle is given by 
A(p, and the change in the total entropy becomes 

As tot = -jr + Y + A ^ 

= _(L Q±-W-AE 

/ 1 1 A W + AE 

= q *{t c -tJ — < 9 > 

Let X denote the short form for a trajectory in phase space: {xq — > x% — > X2 — > ■ ■ ■ — > 
x T }, and let X denote the time-reversed path: {x <— X\ <r- x 2 4- • • • <— x T }, the 
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subscripts denoting discretized time. According to the detailed fluctuation theorem for 
total entropy [HUTU], we then have the following ratio between the probability densities 
for the forward and reverse trajectories, represented by P[X] and respectively: 



P[X] 
P[X) 



-.Astot 



exp 



Qi 



1 



1 

Th 



whose integrated form is given by the new equality 

~ / 1 1 \ W + AE 
exp -Q h — - — + 



W + AE 

Tr 



A0 



A0 



(10) 



(11) 



We next derive a detailed fluctuation theorem for the joint probability 
distribution for work, heat, change in internal energy and system entropy. 



4. Fluctuation theorem for the joint probability distribution 

Using eq. ffTUj) . we obtain a relation for the joint probability density for Q h , W, AE 
and A0. These quantities are odd under time- reversal. 



P(Q h , W, AE, A0) = J V[X\ P[X\ 5(Q h - Q h [X\) 5(W - W[X\) 
x 5(AE - AE(x , x T )) 5(A(j) - A0(x o , x T )) 



V[X\ P[X]exp 



, 1 l\ W + AE ' 



5(Q h -Q h [X}) 



x S(W - W[X}) 5(AE - AE(x , x T )) 5(A0 - A0(x o , x T )). 

Here, T>[X] = T>[X] = dx^dxi ■ ■ -dx T , where x is the time-reversed state of x. We now 
now perform a change of variables from x to x. Then, 

P(Q h , W,AE,A<j)) = exp 



Qh ( rp rp 



W + AE 



+ A0 



x 



V[X] 6(Q h + Qh[X]) 5{W + W[X\) 
x 5(AE + AE(x , x T )) 5(A(p + A0(x o , x T )) 



P{-Qy, 



x exp 



Q 



W, -AE, -A0) 

1 1 \ W + AE 
T~T~ h 



+ Acj) 



(12) 



Here, P(—Q h , —W, —AE, — A0) is the joint probability density for — Q h , —W, —AE 
and —Acf), along the reverse process. Noting that in a TPSS, P and P have the same 
functional forms, we can write 



P(Q fe , ^,AE,A0) 
P(-Qh, -W, -AE, -A<p) 



exp 



Qh 



1 
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Th 
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Eq. (IT3|) readily leads to eq. (ITT]) , which in turn gives rise to the inequality 



(W) + (AE)-T c (A<f>) 



> 



(14) 



In the TPSS, we have, (AE) = 0, and (Acp) = 0. Then we arrive, even for the TPSS 
to the Carnot's theorem, namely, 
(W) 



(Qh) 



< Vc 



(15) 



For T c = Th (system is in contact with a single bath), we retrieve the Seifert's 
integral fluctuation theorem from eq. (ITT]) for a system in contact with a bath at 
temperature T c PUD]: 



exp 



W + AE 
T 



- A(p 



[exp 



( e - Aa *»*> = 1. (16) 



We have used the first law for system in contact with only the cold bath, AE = —W—Q c , 
the first step. If no work is extracted from the system, then the system effectively acts 
as a heat conductor between the two heat baths, giving rise to the generalized exchange 
fluctuation theorem [H] in TPSS: 

AE 



cxp 



-Qh 



1 



1 

Th 



T 



-Acf) 



1. 



(17) 



An example of the above case (eq. (1171) ) would be a particle in a harmonic potential 
coupled to a bath whose temperature changes periodically in time, while no other 
parameters of the harmonic oscillator are changed, and consequently work extracted 
is zero. This model should be experimentally realizable. 

To verify our proposed theorem, eq. (ITT]) , we study a simple heat engine which has 
been experimentally realized recently. Some related points have been clarified through 
the simulations of the distribution functions of physical quantities appearing in our 
theorems. 



5. The model and numerical results 



In this section, we verify eq. (ITT]) numerically. For this purpose, we choose the model 
used in [12], namely, the mesoscopic realization of a Stirling engine. Each cycle in its 
operation consists of the following steps: 

(i) Step 1: an overdamped colloidal particle is initially trapped in a harmonic potential 
with a spring constant k min (state A): V(x, 0) = \k min x 2 . The particle is in contact 
with a medium of temperature T c . Without breaking contact with the heat bath, 
the stiffness constant is subsequently changed, via a prescribed time- dependence 
of this constant k(t), until it reaches a value k max (state B) after a time r. The 
potential function now is given by V(x,r) = \k max x 2 . 
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(ii) Step 2: the bath temperature is suddenly switched to T h > T c (state C). The 
distribution of states of the system does not change during this instantaneous jump. 

(iii) Step 3: now the spring constant follows a separate time dependence due to which 
its value changes from k max to k m i n (state D) over a time r. 

(iv) Step 4: in the last step, the temperature of the medium is once again 
instantaneously switched back to its initial value T c and the system returns to 
state A. The full cycle is then repeated. 

Since in steps 2 and 4, the stiffness constant is held fixed, the work done is identically 
equal to zero in these two steps. We choose the functional dependence for the stiffness 
constant during the transition state A — > state B to be linear and of the following form: 

k(t) = k m i n + q I — 



According to this equation, after time r, the system reaches k max — k(r) — k min + q. 
Similarly, during the transition state C —> state D, the form of k(t) is given by 

k{t) = k max -q(t-l\. (19) 

We find that when the full cycle is complete, i.e. t = 2r, we get back the initial 
spring constant k m ^ n = /l(2t) = k max — q. In our simulation, we choose the values 
of the constants (in dimensionless units) to be k m i n = 1, k max = 2, T c = 0.1 and 
Th = 0.4. Initially, as a consistency check, we verify that for a very slow process (time 
of observation large compared to the relaxation period of the system to its equilibrium 
state), the average work done on the system equals the change in its free energy (quasi- 
static process). In our simulation, we have used Heun's method of integration and have 
generated ~ 10 5 state space trajectories. The changes in free energy during the steps 1 
and 3 are 

AF^ B = ^ln^ (20) 

and 

AF c ^ D = ^ln^, (21) 

* ""max 

respectively. For our chosen parameters, we get AFi^ 2 = 0.035 and Ai^^ = —0.139. 
From our simulation, we obtain the average works done in steps 1 and 3 reach these 
values as we increase the time of observation. For r = 50, we obtain (W)a^b = 0.036 
and (W)c-yD — —0.138, respectively, which match with the theoretical results, within 
our numerical accuracy. 

For reaching the time-periodic steady state, we leave out several initial cycles to 
skip the transient regime. For this TPSS, we have chosen r = 5, and we obtain the 
value of eq. ( II ip to be 1.083, which is very close to unity. Thus, the above relation is 
verified in our numerical simulations. 

Now we study the behaviour of As to t ( e q- ©) when each realization of the 
experiment consists of a large number of cycles. It apparently seems that since AE 
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and A0 are state functions, while Qh and W scale with time of observation, in the limit 
of a large number of cycles, we will have vanishing contribution from the state functions 
to the fluctuation theorem. To verify this numerically, in figure [T^a), we have plotted 
the distributions for Qh, W and AE for a single cycle of the heat engine. AE being a 
state function is symmetric about the AE = axis. In figure [T^b), the distribution for 
change in system entropy, A<p, is plotted for a single cycle. 
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Figure 1. (a) Distribution of Qh, W and AE for a single cycle of the heat engine in 
a steady state, for r = 5. (b) Distribution of Acj) for the same parameters. 
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Figure 2. Distribution of Qh, W and AE for 10 cycles of the heat engine in a steady 
state, with the half observation time r = 5 for each cycle. 

In figure El we have plotted the distribution functions for Qh, W, AE and A0 for 
10 cycles in the steady state. As expected, we find that the distributions for Q h and 
W tend towards a Gaussian and shift towards right, but those for AE and A0 remain 
similar to the case of a single cycle. 

In figure El we have plotted distributions of R = Qh(l/T c — l/T h ) — W/T c (which 
is the extensive part of As tot) and of As to t itself. In figure [31(a), we find that the two 
quantities follow distributions that are slightly different from each other. In figure [3] (b), 
we find that when we take a large number of cycles, the distributions begin to coincide. 
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Figure 3. (a) Distribution of the R = Q h {l/T c -l /T h ) - W/T c , which is the extensive 
part of Astot and of As tot itself, for a single cycle in steady state, (b) Same distributions 
for 10 cycles, and we still find an appreciable difference between the two. 



This is because the contribution from the distributions of state functions become small 
as compared to the contributions from the extensive quantities in the limit of large 
number of cycles. However, it may be noted that the intensive quantities do contribute 
in the extreme tails of the distributions (large deviation). To see this contribution we 
need very high precision simulation in the tail region, which is beyond the accuracy of 
our simulation. This point also arises in the case of heat and work theorems. Work 
obeys a fluctuation theorem. However, due to the contribution from the internal energy 
change, heat does not follow a fluctuation theorem, even in the limit of large observation 
time PEIEE]. 

6. Conclusion 

In conclusion, we have generalized the fluctuation relation for heat engines to time- 
periodic steady states, which leads to the Carnot's theorem. Generalized FRHE leads 
to, in different limits, to the Seifert's theorem, and the generalized exchange fluctuation 
theorem. Our FRHE has been verified numerically in a simple realistic heat engine. 
It would be interesting to check whether the steady state distribution p ss (x,t) in the 
special case specified below eq. ( ITT]) can be calculated analytically, for example, by 
generalizing the method given for time-independent steady state in [17] . Also, the work 
distribution for a system starting from equilibrium and trapped in a harmonic potential 
of time-dependent stiffness constant has been studied in [18J. It would be interesting to 
see whether this procedure can be generalized to deduce the steady state distributions 
of different thermodynamic quantities for the heat engine considered in section |5j 
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